Feb-1 9-04 02 :48pfn P ron-MOTOROLA 



18475763533 



T-606 P. 006/016 F-368 



- PATENT - 

IN THE UNITED STATES PATENT AND TRADEMARK OFUCE 

APPUCANT: Spear etal. EXAMINER: Hyun,S. 

09/274,941 GROUP: 2663 

03/23/99 CASE NO.: CE03880R 



SERIAL NO 
FILED: 
ENTTTLED: 



METHOD FOR TRANSPORTING MULTIMEDIA INFORMATION 
IN A COMMUNICATION SYSTEM 



Motorola, Inc. 
Corporate Offices 
1303 E. Algonquin Road 
Schaumburg, IL 60196 
February 13, 2004 



DECLARATION UNDER 37 C.F,R, S 1-131 



Cortificat© of Transmission under 37 CFR 1 .8 

I hereby certify that this correspondence Is being 
facsimile transmitted to the United States 
^'atent and Trademark Office. 



on -< 




Motorola, Inc. 



Name of applicant, assigneet or 
R^jstered RepresenMive 



Date 




Commissioner for Patents 
Washington, D.C. 2023 1 



Dear Sir: 



Now comes Sanjay Gupta, who declares and states: 
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1. That I am an inventor of the subject matter claimed in the above-identified U.S. Patent 
application. 

2. Prior to January 29, 1999, 1 had corapieted the invention de&cribed and claimed in the 
above-identified U.S. Patent application, as evidenced by the following facts: Prior to 
January 29, 1999, while in the course of research and experimentation at Motorola, Inc., 
and in association with Stephen Spear, my co-inventor in the above-idenrified U.S. Patent 
application, I had prepared and characterized an invention for sending and receiving 
multimedia information in a communication system as evidenced by a Patent Disclosure 
form, dated July 23, 1998, that Stephen Spear and I submitted to Motorola, Inc, A copy 
of the Patent Disclosure form is attached to thuj Declaration. One embodiment of our 
invention provided for receiving a multimedia stream at a mobile station, splitting the 
multimedia stream into multiple component pieces or multiple streams at the mobile 
station, applying Layer 2 protocol or functionality to each component piece or stream and 
applying channel coding to the component piece or stream at the mobile stadon based 
upon whether the component piece or stream comprises one or more of audio, video, and 
data, and transmitting the component pieces or streams. Another embodiment of our 
invention provided for receiving multiple streams that together form a multimedia 
session, decoding, based upon whether the content of each individual stream comprises 
one or more of audio, video, and data, the multiple streams to form multiple decoded 
streams, and performing Layer 2 ftinctionality upon each of the multiple decoded streams 
based upon whether the content of each individual stream comprises one or more of 
audio, video, and data, 

3. The date of the Patent Disclosure form that Stephen Spear and 1 submitted to 
Motorola, Inc., ±at is, July 23, 1998, is prior to January 29, 1999, that is, the date of the 
Ahmadvand patent, U.S. patent no. 6,477,670, cited by the Examiner in rejecting our 
application in an Office Action dated December 17, 2003. 

4. The undersigned Declarant declares further that all statements made herein of his own 
knowledge are true and tliat all statements made on information and belief are believed to 
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be mie; and further that these statements were made whh the knowledge thai willful false 
statements and the like so made are punishable by fine or imprisonment, or both, under 
Section 1001 of Title 18 of the United States Code and that such willful false statements 
may jeopardize the validity of this application or any patent issuing diereon, 

5, Further Declarant saith not. 




Date 




Sanjay Gupta 



3 
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DISCLOSURE FOR PATENT COMMITTEE 
SUBMITTED PURSUANT TO EMPLOYMENT AGREEMENT 

FOR INSTRUCTIONS FOR COMPLETION REFER TO 
DISCLOSURE INSTRUCTION PROCEDURE 



InventQr(s) will not fni In 



Patent Committee Action 



inventor(s) b(aine(s) 
sheets U 



inventor must fill In items 1 thru 13. Items 2 to 5 may require extra 
EE SURE that ail attachments are signed and dated by both the inventor(s) and witnesses. 



1. Name of the invention. (Umit to ten word.) 

Adaptation to support multimedia communicaiions in a Packet Switched Cellular Network 

2. State the problem($) solved by the invention. 

See Attached 



3. Describe the Invention, including Its operation, purpose and environment (Use separate sheets as required). 
See Attached 

4. 



Ust the closest known technology (attach article, patent, catalog sheet or other documentaUon). 
See Attached 



5. Improvement(s) over known technology. 
See Attached 



6. What new elements (e.g. components, circuits, process steps) or combination of known elements or software 
algorithm produced the Improvement? 

See Attached 

7. What are the potential applications for use of this invention? 

See Attached 



(Attach earliest log sheets, drawings, eto>, to support dates). 



a. Conception date? _April 1 99B 

To Whom did you first disclose this lrtventlQn?l^ame; Jhilip Gilchrist 



.Pateg_July1S, 1998. 



ia Date the device was first built and tested* ^No_ 

Present location of the device? 



DETERMINATION OF LEGAL INVENTORSHIP WILL BE BY THE PATENT DEPARTMENT. 



Inventor's signature (II^POBTANT - YOU MUSTVSB YOUR FULL NAME) - NO INITlALS- 



11. Inventor's Full Name: (Type): 

Stephen Spear 

Home Address: Street 
25 Williamsburg 

Citizen of (l.e. U^, Germany, etc.) 
USA 

Inventor's Immediate Supervisor 
Jerry Campbell 



Signature 



City 
Skokte 



Pate 

State 

niiitois 



Social Security No. 
344-38-0983 

Country Zip Code 
USA 60203 



Dept No. Phone 
BC597 2-5251 



Dept No. 
BC597 



Phone 
5-2162 



Room No. 

3205-AR 
Social Security No. 
510-46-2151 



Employee Status 
13} Permanent □ Contractor 
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Page 2 - Disclosure No. 



12. Inventor's Full Name: (Type): 
Sanjay Gupta 



Home Address: Street 

6720 N, Lakfiwood Avenue, Apt 1 



Motorola Confidential Proprietary 



Signature 



Date 



Chicago 



state 
Illinois 



Social Security No. 

161-70-4436 

Country Zip Code 
USA 60626 



Citizen of (le.U.S., Germany, etc.) DeptNo. Phone Room No. Employee Status 

India BD537 847-435-0306 gj 

Permanent □ Contractor 



Inventor's Immediate Supervisor 
Antony Susai 



13. Inventor's Full Name: (Type) 



Dept No. Phone Social Security No. 
BD537 847-632-3972 470-94-2310 



Signature 



Date 



Social Security No. 



Home Address: Street 



City 



Stale Country Zip Code 



Citizen of (i.e, U.S-, Germany, etc.) 



Inventor's Immediate Supervisor 



Dept No. Phone Room No. 



Employee Status 
□ Permanent Q Contractor 



Dept. No. Phone 



Social Security No. 



Witness signatures pwo WITNESS ES ARE REQUIRED), vtfitness must sign and date this form and all attachments. 
THE WITNESSES IN SIGNING THIS FORM ATTEST TO THE FACTTHATTHEY UNDERSTAND THE INVENnON. 



1 4. Witness Name: (Type)_AntQny SusaL 



^ Signature. 



tone 2-3972 



15. Witness Name; fTyp al ^^^^-^^^^Slon ature 

items 16 thru 24 are to be filled In by the ENGlNEERlNG/PROOUCT'ilV^AGER or at)ov^ 
THE MANAGER IN SIGNING THIS FORM ATTESTS TO THE FACT THAT HE UNDERSTANDS THE INVENTION. 



^te 1 hlkfP honB 2- - 2. 
Tabovi' 



ia What product will this invention be used In? (No code names - use brief description if necessary) 

Motorola GS M GPRS and UMTS Products 

17. When (was) (will) the first offer for sale of a product incorporating this Invention (be) made? 

Date;_2Q20QO 

ia When Is the estimated shipping date? 2Q 200Q ^ 

1 9, When (was) (will) the first disclosure outside of Motorola (be) made? How and to whom? Nondisclosure 
agreement signed? State title and date of publication, if any. 

Customer presentations IQ 1999 



20. What is the market for products incorporating this Invention? Be specific and quantitative. 
DigiCiil Cellular Networks Worldwide 

21- Who are the potential competitors? What is the possibility this Invention wll be used by competitors? Which 
ones? 

Ericsson* Nokia. Nortel, Siemens, and other GSM cellular network suppliers. All may use the invention. 



22. Did this Invention result from work on a development Contract? (YES) (NO) Contract No. 

Who was the contracting party? 

23. Discuss the business Impact that this Invention wll have on Motorola. Be specific and quantitative. 



24- Manager's Name fType) 
Donald E, Benkcser 



Date 




Dept No. Phone 

BD537 S47-435-0137 



Motorola Confidential Proprietary 
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1. Name of the Invention. 

"Adaptation to support multimedia communications in a Packet Switched Cellular 
Network*" 

2. State the problem(s) solved by the hivention. 

Multimedia conmiunications involves simultaneous use of one or more media services 
(such as voice, video, data, etcO in a single communication session. Recently, a number 
of standards, such as H.323 have been defined that address the requirements for 
multimedia communications in a wireline packet switched network. Recently, GPRS, a 
packet switched network overlaid on the exisitog GSM network, has been standardized 
byETSL 

Given the above trends in the wireline and wireless communications there is an increased 
desire to support multimedia applications in wireless cellular networks. Further, in the 
interest of fixed-mobile convergence there is an emphasis on employing (or reusing as 
much as possible) existing wireline protocols for wireless networking applications- 
While it is possible to provide the multimedia services transparent to the wireless networic 
there arc various problems associated with support of multimedia applications in wireless 
applications: 

(i) ' In wireline ^plications tra^c from the various component media streams are 

treated the same. However, in wireless networks, different media streams must be 
treated differently for optimum performance. For instance, the channel coding 
used is usually dependent on the media being transported. Further, different 
Quality of Service objectives may be suited for different traffic streams (example, 
voice codecs may be more resilient to errors than video codecs). 

(ii) Wireless environments are typically poorer (when compared to wireline 
transmission chaimels) and further complicating matters is the fact that the 
channel error characteristics change quite rapidly* Transport protocols (such as 
TCP) in wireline networks are tailored for the relatively en^r free wireline 
environment and are unlikely to perform as desired in wireless enviromnents. 
Retransmission is a means of improving end to end performance but is not 
appropriate for all media streams* 

(iii) The overhead associated with wireline protocols is significant (especially when 
used as is over currently defined wireless packet networking protocol stacks). This 
renders their use over scarce wireless transmission capacity a liability. 

In short, the multimedia applications of today are designed 

(i) Without regard to bandwidth and overhead and 

(ii) In a manner such thai the lower layers (Layer I , Layer 2, and Layer 3) are not 
aware of the concents of the data they transfer (or the application that generated 
the data being transported by them). 

Inventor y^^^--''-'^'^^'^^''^ ' Wimess . 

— a. 
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This is clearly inappropriate for wireless multimedia applications, since given the 
unpredictable nature of scarce wireless channels it is essential that the lower layers be 
tailored to meet the specific demands of the various traffic types. 

3. Describe the Invention, Including its operation, purpose and environmenL 

This disclosure addresses the above mentioned problems by providing the lower layers 
(LI, L2, and L3) information about the nature of the contents of the data' being 
transported by them (which allows them to then provide service that is tailored .for each 
data type). The proposed middle-ware allows the use of wireline appUcations on an end- 
lo-end basis without the above mentioned liabilities. 

This disclosure identifies appropriate middle-ware for both the Mobile Station (MS) and 
the Network Infrastructure that will enable: 

(i) multimedia applications to be transported efficientiy over wireless networks; 

(ii) be able to use existing (and forthcoming features) designed to support single 
media streams in wireless networks; 

(iii) existing wireline multimedia standards to be used end-to-end. 

The functions performed by the middle-ware include: 

(i) Separating the component media streams (of a multimedia session) before 
transporting them on the wireless network; 

(ii) ' Merging the component media streams received from the wireless network before 
forwarding it to the wireline network and/or the application at the MS; 

(iii) Adapting each component media stream to die wireless environment (alternate 
coding schemes for voice or video). This could possibly involve transcoding, 
filtering (for instance reducing the resolution of images, or data as performed by 
WAP) operations, or operations tiiat make die media stream to be more suitable 
for transmission over a wireless channel. 

(iv) Requesting appropriate channel coding resources for each component media 
stream; 

(v) Requesting appropriate Link Layer retransmission scheme parameters for each 
component stream (for instance no retransmissions would be allowed for voice 
and video, whereas retransmissions would be mandatory for data); 

(vi) Perfonning header reduction techniques (potentially specific to each media 
stream). For IP traffic, known header compression could be used. Alternatively, a 
specific for transport of IP over wireless networks could be developed. 

(vii) Deletion of IP . headers for specific PDP contexts. For instance, for die PDP 
context associated with the voice stream^ the technique identified in disclosure 
CE0375 IR could be employed. 



' Note that multiple traffic types arft multiplexed in the same L3 traffic stream in a multimedia application. 
--^^^^^ Witness 



Tnvgntnr. . V^^^ 



Tvii/^TIT/M* 



Witness 
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Note that 

(i) The use of proposed middle-ware allows existing bearers (designed for 
transporting single media streams) to be employed within a multimedia session* 

(ii) The proposed middle-ware could be located at either the BSS or the NSS in the 
network infrastructure. Further, it is possible that some functions are located in 
the BSS and the others in the NSS. 

To facilitate proper operation of the middle-ware additional signaling between the two 
peer middle-ware entities (in the MS and the network inftastnicture) is introduced. In 
order to communicate between the middle-ware components located in the BSS, L2 
messages are most likely to be employed- For communication between the middle-ware 
components located in the NSS, L3 messages may have to be employed. Altematively, 
the BSS can act as a proxy for the MS and communicate with the NSS, reducing the 
requirement for L3 messaging- 

The contents of messages between the middle-ware entities include: 

(i) Identification of request for activation due to multimedia call 

(ii) Negotiation of coding for each component media stream 

(iii) Requested channel coding for each component media stream (in GPRS 
each component stream will most likely be associated with a unique PDF 
context" (note that this will require L2 signaling as identified in disclosure 
CE03751R) 

(iv) The L3 port/socket used for rransmitting and receiving component media 
streams in the wireline network. 

(v) PDP context used for transporting various component media streams, 

(vi) Information necessary to provide the necessary synchronization between 
the con*?onent media streams. 

An overview of the proposed call establishment procedure for a multimedia call for 
wireless network is outlined below. For simplicity, GPRS is assumed to be the underlying 
wireless transport network. The originating station, assumed to be an MS for the 
discussion here, activates a PDP context (in the GPRS network) for the multimedia 
session. SubsequenUy. the MS sends appropriate signaling messages to the destination 
and requests a multimedia session. Having received an indication of the ability of the 
destination station to accept the multimedia call request, the MS invokes this invention. 

The MS requests the activation of a new (distinct from the one activated above) set of 
PDP contexts (one for each component media stream)^ each with its own specific channel 
coding scheme (this is most likely to be performed via an in-band signaUng mechanism). 
Subsequently, it transitions from a signaling only stage to the user traffic transfer stage. 



' In GPRS an MS can have several PDP contexts active simulianeously, 

* Note thai this can optionally be performed prior to (or simultaneously with) sending the multimedia call 
request to the destination- j 
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Alternatively, the MS can recognize the request for a multimedia call and request the 
middle-ware residing in the network to setup a single multimedia call with the request for 
individual PDP contexts for each component media stream, as described above. In this 
case the BSS (or NSS) takes on a slightly enhanced role of agent for the MS to request 
the single multimedia session to the wired network while supporting multiple individual 
sessions over the air. 

4. List the closest known technology* 

The closest known technologies are: 

1. Method to transfer voice on a packet switched cellular network as identified in 
disclosure CE03751R- 

2. The mechanisms used in the Wireless Application Protocol (WAP) for 
efficient transfer of asynchronous data over wireless channels. 

3. Mechanism for the in-band transmission of "control" information between the 
MS and the BSS when an MS is involved in a voice call in GSM, 

4. In-call Codec negotiation for data services and in-call modification of a voice 



S* Improvfiment(s) over known technology. 

The proposed invention offers the following improvements over existing systems: 

L Enhanced quality (for each component traffic stream) when compared to the 
case in which component traffic streams are merged (as in wireline networks). 

• AUows the MS and/or the network to request channel coduig resources 
appropriate for each component stream of a multimedia call. 

♦ Allows each component traffic stream to be transmitted without the 
addition of any overhead. This allows increased air interface capacity 
utilization, 

♦ The proposed tniddle-ware can also be used to reduce the overhead 
associated with transporting IP data traffic 

• Allows the network to optimize each component media stream separately 
(perform transcoding^ filtering, etc,) 

2. Existing wireline plications can be continued to be used by the MS. 
3* If the middle-ware is implemented in die BSS, there are no impacts to the Gb 
interface and the GSNs (both SGSNs and the GGSNs). 

6. What new elements or combination of known elements or soft\vare algorithm 
produced the Improvement? 

The following new mechanisms are needed to efficiently transport multimedia on a 
packet switched cellular system such as GPRS: 



Inventor ^v;:^'^- Wimess 
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L Introduction of middle-ware at the MS and the network infrastructure. The 
middle-ware informs the Layer 1, Layer 2. and Layer 3 of the source (voice» 
video, and data) that generated the data being transported by them. This allows 
the lower layer to provide services that are tailored to each source type. 

2. Functionality in the network and the MS to convert between the single 
multimedia PDF context stream and the multiple component media streams 
and the required control to support the above. 

3. Additional signaling between the middle-ware residing at the MS and its peer 
entity residing in the network inftastructure. (Note that the middle-ware in the 
network infrastructure could be distributed over more than one physical 
entity.) 

4. Ability of an MS to request for multiple PDP contexts all of which are 
associated with a single end-to-end multimedia call. 

5. Changes in the transport plane as specified in GPRS currently. For instance, if 
the proposed middle-ware is implemented at the BSS, the BSS now terminates 
the IP. LLC and SNDCP layers on behalf of the MS. 

7. What are the potential applications for use of this invention? 

The invention can be used for 

1. Transferring multimedia applications on the GPRS network aUowing seamless 
networking with existing wireline technologies. 
' 2. It is expected that such a solution will also be used in UMTS for multimedia 
applications* 
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Figure 1: Multimedia Application before Invention 



Inventor 




Witness 
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Figure 2: Multimedia Application after Invention 
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